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Introduction: Patients with sickle cell disease (SCD) often seek care in emergency departments 
(EDs) for severe pain. However, there is evidence that they experience inaccurate assessment, 
suboptimal care, and inadequate follow-up referrals. The aim of this project was to 1) explore the 
feasibility of applying a failure modes, effects and criticality analysis (FMECA) in two EDs examining 
four processes of care (triage, analgesic management, high risk/high users, and referrals made) for 
patients with SCD, and 2) report the failures of these care processes in each ED. 

Methods: A FMECA was conducted of ED SCD patient care at two hospitals. A multidisciplinary 
group examined each step of four processes. Providers identified failures in each step, and then 
characterized the frequency, impact, and safeguards, resulting in risk categorization. 

Results: Many "high risk" failures existed in both institutions, including a lack of recognition of 
high-risk or high-user patients and a lack of emphasis on psychosocial referrals. Specific to SCD 
analgesic management, one setting inconsistently used existing analgesic policies, while the other 
setting did not have such policies. 

Conclusion: FMECA facilitated the identification of failures of ED SCD care and has guided quality 
improvement activities. Interventions can focus on improvements in these specific areas targeting 
improvements in the delivery and organization of ED SCD care. Improvements should correspond 
with the forthcoming National Heart, Lung and Blood-sponsored guidelines for treatment of patients 
with sickle cell disease. [West J Emerg Med. 2014;15(4):446-458.] 



INTRODUCTION 

Sickle cell disease (SCD) is a painful, chronic, genetic 
condition that affects 90,000-100,000 individuals in the U.S. 1 
and shortens life expectancy to around 40 years. 2 5 While 
there is wide variation in the use patterns of healthcare by 
SCD patients, particularly of emergency department (ED) 
care, there is also substantial evidence of generally poor 
quality of care for SCD patients in the ED. 6 " 8 The Emergency 
Department Sickle Cell Assessment of Needs and Strengths 



(ED-SCANS, http://sickleemergency.duke.edu/) was 
developed as a quality improvement (QI) framework for seven 
key clinical processes of SCD ED care. Patient and clinician 
characteristics make providing care to persons with SCD 
in the overcrowded ED a challenge. 6,910 The diminishing of 
attention to pain and pain management in the ED, partially due 
to crowding, often results in delays to analgesic medication 
administration. 11 

A FMECA, a prospective quality improvement and patient 
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safety approach, was applied and sought to identify and 
qualify risk contributors, often generic, to failed processes and 
systems. Through risk binning, that is attributing high to low 
risk characteristics to each process, as well as characterizing 
the frequency and existing safeguards of these potential 
adverse events, systems and processes can be assessed as to 
the consequences of failure and their likelihood as causative 
factors. The FMECA approach was developed by engineers 
and originally employed in high-risk industries, such as 
aeronautics, aerospace, and nuclear power, to identify potential 
system and process vulnerabilities. 12 It has been increasingly 
applied to complex healthcare processes, including intravenous 
drug administration, blood transfusion, and sterilization of 
surgical instruments. 13 " 23 In healthcare, a FMECA is conducted 
through multidisciplinary meetings with clinicians and staff 
who are involved with and knowledgeable about the system 
and processes under investigation with the goal of eliciting 
and generating a comprehensive description of all steps in 
a defined, specific clinical care process. Although time and 
resource intensive, a FMECA can provide a robust assessment 
of potential risks in the healthcare processes and systems and 
serve as the platform for significant process improvement and 
system redesign. 24 

We selected this approach over several other quality 
improvement approaches including value atream mapping 
(VSM) and root cause analysis (RCA). VSM seeks to identify 
those events which lead to "waste" of resources, especially 
time, i.e., process inefficiencies; our aim was not to evaluate 
the overall waste of resources. 25 RCA was not selected because 
it evaluates a system event after its occurrence and evaluates 
trends and assesses risks of underlying causal factors. Our goal 
was to evaluate specific processes of care in each ED, not in 
response to a specific event. 

Caring for persons with SCD in the ED is complex 
from a medical, psychosocial, and health services utilization 
perspective. Pain associated with vaso-occlusive crises 
(VOC) remains the most common complaint of SCD patients 
seeking care in the ED. 26 Additional reasons for ED visits 
include other medical complications not limited to chronic 
anemia, iron overload from multiple transfusions, ischemic 
and hemorrhagic strokes, acute chest syndrome, pulmonary 
embolism, pneumonia, and renal failure. 3 VOC requires 
parenteral analgesics and is highly time sensitive due to the 
mortality risk of ischemic or infectious complications. 27,28 
Current guidelines for the management of VOC from NHLBI 
and the American Pain Society recommend the following: 
(1) immediate assessment and differentiation of typical pain 
episodes from other complications of SCD; (2) rapid assessment 
and determination of pain medication requirements and pain 
control with opioids within 15-20 minutes of ED arrival; and 
(3) re-assessment of pain every 15-30 minutes. 2930 These current 
guidelines are outdated, especially in this age of ED crowding, 
with unrealistic expectations of door to first dose of 30 minutes, 
and repeat doses reduced by one-quarter to one-half the initial 



dose. In an effort to provide more current, evidence based 
practice for treating SCD, the National Heart Lung and Blood 
Institute formed an Expert panel to develop evidence-based 
guidelines. This report will be published in 2014. 

Clinicians, however, report significant barriers to following 
recommended guidelines in the ED and frustration with the 
care and management of SCD patients. Some perceive SCD 
patients to be "drug seeking" and many providers report a lack 
of understanding of opioid requirements for SCD and other 
chronic pain patients, especially those on chronic daily opioid 
therapy. 31 Clinicians are reluctant to order and administer 
appropriate high-dose opioids, resulting in delays and sub- 
therapeutic treatment of VOC episodes. 6 31 A further frustration 
of ED clinicians is the frequent use of the ED by a small 
fraction of patients with SCD, who may make 100 or more 
visits over several years. 6 32,33 The research team hypothesizes 
that the population of SCD patients with such intense ED 
use may well have other significant neurocognitive deficits 
and unmet psychosocial healthcare needs that lead to such 
dramatically high ED use. Ultimately, care of the patient with 
SCD in the ED is multifaceted and complex. 

The aim of this project was to 1) explore the feasibility 
of applying a failure modes, effects and criticality analysis 
(FMECA) in two EDs examining four processes of care (triage, 
analgesic management, high risk/high users, and referrals made) 
for patients with SCD, and 2) report specific failures of these 
care processes in each ED. 

METHODS 

Study Design and Sample 

We conducted a prospective FMECA at two urban EDs 
in the Southeastern United States, each affiliated with an 
academic medical center and with an emergency medicine 
residency training program. Site 1 had an adult ED patient 
volume of about 61,000 in 2011, with nearly 600 SCD visits 
annually. Site 2 had an adult patient volume of 73, 000 in 
201 1, with nearly 500 annual SCD visits. 

We recruited FMECA participants because of their 
involvement with and knowledge of the care of SCD patients 
in the ED. Participants at each site included representatives 
of ED physician and nursing leadership, ED physicians 
and nurses, an ED pharmacologist, ED and hospital social 
workers. Select members of the Sickle Cell Clinic team 
(hematologists, nurses, one physician assistant, nurse 
practitioner, social worker, and educator) also participated. 
One patient with SCD who received care at each site was 
also recruited to contribute. Members received a $75 gift 
card for participation. Two in-person FMECA sessions were 
held at each of the two sites. The project was approved 
by the institutional review boards at both study sites and 
participants provided written consent. 

Procedures 

Quality Improvement Framework: Emergency Department 



Volume XV, NO. 4 : July 2014 



447 



Western Journal o/Emergency Medicine 



Application of a Proactive Risk Analysis 



Thornton et al 



Sickle Cell Assessment of Needs and Strengths (ED-SCANS) 

Four of the seven processes recommended by the ED- 
SCANS were selected for analysis during the FMECA. The 
ED-SCANS is a decision support tool developed as a quality 
improvement framework to address the complex healthcare needs 
of SCD patients in the ED; it is comprised of seven algorithms 
(http://sickleemergencyduke.edu/). 10 The ED-SCANS can be 
used to guide the clinical management of individual SCD patients 
in the ED and develop best practice protocols to support their 
care in that setting. Four algorithms — (1) triage; (2) analgesic 
management; (3) identification of the high risk/user; and (4) 
need for referrals to a physician or for psycho-social support if 
discharged home — were the focus of desired QI activities and 
this FMECA. Due to the complexity of conducting a FMECA to 
analyze four processes, we determined that processes relevant to 
the other three ED-SCANS algorithms (diagnostic evaluation, 
disposition, and need for an analgesic prescription if discharged 
home) would not be assessed. Future work would be necessary 
to analyze these processes. A brief description of each of the four 
algorithms is outlined below: 

1 . Triage: Assessment of vital signs and chief complaints 
suggestive of something other than pain related to a VOC 
and assignment of a triage priority score. 

2. Analgesic management: Individualized pain 
management, or generic departmental pain management 
protocols, or weight-based or patient-controlled 
analgesia (PCA) opioid dosing regimens 

3. Assessment of the high ED user/high risk patient: Denned 
as patients with more than 3 ED visits or hospitalizations/ 
year, SCD patients who do not have a primary care provider 
(PCP), or have other difficulties obtaining appointments, and 
SCD patients who are pregnant; and 

4. Referrals: Identification and coordination of medical 
and psycho-social referrals made in the ED for 
discharged patients. 

Session 1: Process Mapping. 

In the first FMECA session at each site, the research team 
explicitly identified the process boundaries of ED SCD care 
for each of the four processes (triage, analgesic management, 
identification of the high- risk or high-user patients, and referral). 
Participants were encouraged to describe their own involvement, 
tasks, and experiences during the process of caring for an SCD 
patient and to comment on routinely used "workarounds" or 
"shortcuts" rather than recite hospital protocols and policies. 13 - 34 37 
After completion of Session 1, the research teams translated the 
description of each of the four SCD processes into site-specific 
process maps for each decision (Microsoft Visio 2010; Microsoft 
Corporation, Redmond, WA). The researchers then used the 
process maps to create a site-specific FMECA risk assessment 
chart for each decision, a document that listed all ED SCD care 
process steps, using Excel software (Microsoft Excel 2010; 
Microsoft Corporation, Redmond, WA). 



Session 2: Risk assessment. 

During the second FMECA session at each site, participants 
were given each of the four site-specific process maps. These 
maps were used to populate the 'process step" column of the 
FMECA risk assessment charts developed for each process 
(triage, analgesic management, high risk/higher user, and 
referrals) at each site. To complete the risk assessment charts, 
participants systematically reviewed each process step for 
each process map, and identified, for each step, weak points or 
failures and their causes (failure mode causes). Next, FMECA 
participants, as a group, estimated the frequency of each 
identified potential failure and the likely consequences for the 
patient of each identified potential failure. 

Finally, to qualify the most critical systematic and process 
failures, the research team applied a method, developed by the 
US Department of Energy and adapted for healthcare, in which 
each potential failure is categorized by a "risk bin," depending 
on its frequency and consequence scores. 36 The process of risk 
binning permits the prioritization (from highest to lowest by 
significance and frequency) of failures for selection for targets 
of QI initiatives and efforts. Following the second session, 
researchers met with individual participants, as needed, to fill in 
any perceived gaps in the risk chart. 

In Session 2, frequency of a potential failure was 
measured as remote (Fl), uncommon (F2), common (F3), or 
frequent (F4). Consequences to the patient of each identified 
potential failure were measured as none (CI), some (C2), 
serious (C3), or significant or certain (C4). Criticality risk bins 
were categorized as low, medium or high (Table 1). A failure 
with a high frequency score (F4) and a high consequence 
score (C4), for example, was ranked as a "high" criticality 
failure, whereas a failure that occurred at a high frequency 
rate (F4) but had little consequence (CI) was scored as a 
"low" criticality failure. 38 Safeguards for the processes were 
explored and rated as (SI) if a formal policy or procedure 
was in place to prevent the failure, (S2) if the process was a 
standard of practice with no policy in place, and (S3) if there 
was nothing. For example, a policy existed at Site 1 that 
allowed the triage nurse to obtain an analgesic order from a 
physician in the event of delayed placement in a treatment 
space. This was rated as (SI), to address the risk of delays to 
analgesic administration, despite the existence of a policy and 
procedure, in the event of crowding. 

Data Analysis 

All sessions were digitally recorded and transcribed, 
and the research team also took detailed field notes. After 
the first and second sessions, FMECA participants were 
asked, independently, to review their site-specific process 
maps and risk charts and to offer revisions or corrections and 
researchers met with individual participants, as needed, to fill 
in any gaps. We then examined the final four process maps 
and FMECA risk assessment charts from each site to identify 
similar and different risks across both study sites. 
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Table 1 . Risk matrix for frequency and consequence of a failure. 



Frequency 




Consequence 






CP1 


CP2 


CP3 


CP4 




none 


oUI 1 IC 


oCI lUUo 


significant 


F1 

remote 


Low 


Low 


Low 


Medium 


ro 

rZ 

uncommon 


Low 


Low 


Medium 


Medium 


F3 

common 


Low 


Medium 


Medium 


High 


F4 

frequent 


Low 


Medium 


High 


High 



Table used with permission and adapted from G Coles, B Fuller, 
K Nordquist, et al. Three Kinds of Proactive Risk Analyses for 
Health Care. Joint Commission Journal on Quality and Patient 
Safety. 2010; 36:365-375, Appendix A. 



Table 2. Participants by site in a risk assessment analysis related 
to patients with sickle cell disease (SCD). 

Provider Type/site Number of participants 



Site 1 Site 2 

Hematologist 1 1 

Emergency Physician 4 2 

Emergency department (ED) „ „ 

b 3 

nurse 

Nurse practitioner 3 0 

Physician assistant 0 1 

Pharmacist 1 0 

ED administrator 2 2 

Educator 3 0 

Social worker 2 1 

SCD Patient 1 1 

Total 23 11 



RESULTS 

The FMECA included a total of 23 participants. Participant 
characteristics for each site are described in Table 2. Each 
FMECA session lasted approximately three hours. A process 
map and risk assessment chart was developed for each of the 
four processes. Because the process maps were developed to 
inform the risk assessment chart, only results from the risk 
assessment charts are presented and discussed. An expert 
facilitator led the FMECAs, and high-level support from 
physician and nursing leadership to encourage participation was 
a key component. Despite the complexities of describing SCD 
ED care at two different sites, the application of FMECA was 
feasible and participants reported high satisfaction with having 
an opportunity to identify failures and vulnerabilities in the 
high-risk processes that lead to breakdowns in SCD ED care. 
The FMECA required more time to complete than originally 
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planned. Results specific to each of the four care processes are 
discussed below. 

Triage and Analgesic Management 

Both sites identified multiple, similar complex failures 
in triage and analgesic administration, despite significant 
differences in their protocols. For example, at both sites 
triage nurses assessed vital signs and chief complaints and 
attempted to determine if an open ED bed was available. If 
a bed was not available patients were placed in the waiting 
room. This process step was identified as high risk because 
it occurred frequently due to ED crowding at both sites, and 
because of erroneous triage assessment, and resulted in a 
delay in SCD patients receiving analgesics, the potential of 
undetected serious complications, and an inability to perform 
recommended re-assessments. However, Site 1 offered the 
triage nurse an option of requesting and obtaining an order for 
a first and repeat dose of sub-cutaneous opioid for any SCD 
patient with an existing treatment plan, when an ED bed was 
unavailable. However, it was widely acknowledged that triage 
nurses infrequently used this option. Site 2 did not have a 
similar option. 

While several policies were in place at Site 1 to facilitate 
analgesic management, widespread lack of implementation 
and adherence was identified as a key failure. Obtaining timely 
intravenous access was a high-frequency, high-risk process at 
both sites, which contributed to significant delays in receiving 
analgesics. Site 1 used individualized analgesic dosing 
protocols available in the electronic medical record, and 
weight-based dosing was used when individual protocols were 
not available. Site 2 had a generic analgesic protocol available 
for management of ED SCD patients, but it, reportedly, was 
often not used. Site 1 also used a patient-controlled analgesia 
(PCA) protocol that required re-assessments of pain every 
10 minutes with orders for re-administration of additional 
doses through the PCA. However, the protocol was usually 
not followed because of its complexity. Re-assessment and 
re-dosing for unrelieved pain were identified as high-risk areas 
at both sites. Difficult intravenous access was another barrier 
to providing rapid administration of analgesics at both sites. 
While resources such as ultrasound were available at both 
sites, they were frequently not used. Process steps, potential 
failures, consequences, safeguards, and risk bins for analgesic 
administration at both sites are presented in Tables 3 and 4, as 
examples. 

High ED Use and High Risk Patients 

Quality care processes to identify ED patients with high ED 
use or those at high risk did not exist at either site. For example, 
while participants at both sites acknowledged significant 
frustration with a small number of patients who were high ED 
users, neither site had any formal process in place to identify 
this subset of ED SCD patients in "real time," nor any formal 
process for reviewing these cases and identifying solutions. 
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Referrals 

The ED-SCANS recommends a brief psychosocial 
assessment to identify unmet needs of patients who might 
benefit from follow-up services after discharge to the 
community (http://sickleemergency.duke.edu/sites/default/ 
files/ED-Scans Adult-Algorithms.pdf). Neither site had any 
process in place for conducting a psychosocial assessment, 
even for patients with frequent ED visits or those at high risk 
of severe disease. Although Site 1 had both a SCD program 
social worker and ED social workers who could assist 
with psychosocial assessments and referrals, there were no 
process guidelines in place to use these resources. Site 2 had 
no identified ED staff to assist in performing psychosocial 
assessments or making referrals. 

DISCUSSION 

This study involved the performance of a complex 
FMECA of all steps involved in four processes of ED care 
for patients with SCD, based on a SCD QI framework, the 
ED-SCANS. We found multiple processes were reflective of 
high-risk areas. We carefully followed the process of assigning 
frequency and criticality. The large number of high-risk areas 
is reflective of how complicated and in need of improvement 
the care processes are. Caring for persons with SCD in the ED 
is not just about pain. 

In general, key findings at Site 1 were the following: (1) 
poor adherence to current analgesic protocols, and (2) failure 
to maximize the use of existing resources. In general at Site 2, 
the FMECA identified (1) a lack of structured SCD ED care 
processes and protocols, and (2) lack of resources to provide 
optimal SCD ED care. Patient input at each session was 
invaluable. As existing policies and processes were discussed, 
patients often validated the lengthy delays to analgesic 
administration and that these processes were not used. For 
example, at Site 1 triage nurses are allowed to administer 
an analgesic in the waiting room if a delay is unavailable. 
Patients verified that they were unaware of this option, and not 
offered analgesics at triage. 

Reports from both sites indicate that findings from the 
FMECA are being used to guide ongoing QI efforts. Members 
of the FMECA teams at both sites continue to meet monthly. 
Collaborative efforts between the two sites are continuing 
through monthly teleconference calls during which progress 
on the identified high-risk areas are discussed. 

Typically, a FMECA is paired with other QI methods. 
For example, a rapid cycle, process improvement method, 
the plan-do-study-act (PDSA), is being used by both sites to 
review the FMECA findings, enact the redesign and process 
improvement, study the results, and implement additional 
process improvements to successfully implement process 
changes. 39 40 Individual members of the teams at both sites 
have used the results of the FMECA to focus their work on 
the two identified high-risk areas: (1) revision of analgesic 
management policies and related clinician education, and 



(2) implementation of processes to obtain psychosocial 
assessments and referrals. At Site 1, the PCA protocol was 
revised to facilitate a more achievable time interval between 
administration of repeat analgesic doses. When no changes 
in real-time processes were noted, the team reviewed the 
risk binning results again and determined that the route of 
administration was a barrier. The protocol was modified and 
the route of administration for initial doses was changed from 
PCA to intravenous bolus doses. Initial results following this 
change have been favorable. Re-education of staff on the 
subcutaneous protocol has also been implemented. At Site 2, 
the emphasis has been on the development of individualized 
opioid pain management protocols and development of a 
SCD-specific protocol. Review of randomly selected medical 
records at each site has shown decreases in times from arrival 
to placement and from arrival to first dose of opioid analgesia. 

Education was identified as a barrier to process re-designs 
implementation. A one-day workshop on SCD was offered 
in 2012, and a two-day workshop was offered in 2013, to 
members at both study sites; FMECA team members from 
both sites attended. A SCD Champion Program was also 
created at both sites, modelled after the pain resource nurse 
(PRN) program established to provide education to nurses 
about SCD and pain management. 41 PRNs participate in unit- 
based QI activities, provide unit-based education to their 
peers, and attend ongoing multi-disciplinary SCD Champion 
quarterly education and operational meetings. SCD Champion 
nurses at both study sites participate in these activities and are 
identified as resource nurses to physicians and nurses in their 
respective departments, and a means of sustaining the progress 
being made. 

The second focus for each QI team was the identification 
of unmet psychosocial needs and follow-up care for patients 
with SCD, especially for persons at high risk or with high 
ED use. At Site 1 , the QI team implemented a process that 
automatically "pages" an ED social worker, upon arrival of 
every adult with SCD. The social worker conducts a brief, 
targeted, psychosocial screening interview to identify unmet 
psychosocial needs. Prior to the last quarter of the project, 
no patients received referrals to psychological or behavioral 
services. Now, all patients are evaluated by the social worker 
during the hours a social worker is available, which includes 
24/7 on weekends and approximately 14 hours/day during 
the week. At Site 2, the team is devising means to engage a 
consistent process that will allow for psychosocial referrals. 
At both sites, high-risk patients and high ED users are being 
better identified. 

LIMITATIONS 

Since this study was conducted in only two institutions, 
the key failures in the process of ED SCD assessment, 
treatment, and referral, as well as the causes, frequencies, 
and consequences, may differ from other institutions. Rather 
than being designed to identify all failures in the systems 
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and processes of ED SCD care, the aim of this study was to 
demonstrate the application, by healthcare clinicians and staff, 
of a proactive, risk assessment methodology - FMECA - to 
the acute, time-sensitive ED SCD process of care, endorsed by 
the ED-SCANS in order to identify potential failures in SCD 
processes of care. The FMECA permitted a ranking of the 
identified failures by greatest risk which, in turn, facilitated 
the selection of ED-specific targets for development and 
implementation of interventions. 

The FMECA approach has some inherent limitations. It 
does not include all staff or clinicians involved in ED SCD 
care and therefore relies on convenience sampling. In this 
study, more clinicians and staff participated at Site 1 than 
at Site 2. Having additional participants may have added 
different perspectives and identified additional steps, failures, 
and causes. Also, it is possible that participants may not have 
identified all of the failures or may have inaccurately gauged 
the frequency or consequence of those identified. To address 
these issues, FMECA moderators asked probing questions 
during the sessions to increase discussion, but it is likely that 
the group did not entirely capture all problems. 42 

An additional limitation relates to the FMECA 
assessment of the failure's consequence score. Evidence 
has shown that participants can be, on the one hand, overly 
optimistic, in that they underestimate potential consequences 
of a process failure due to the hazard being perceived as 
considerably frequent, although no severe consequences 
have actually occurred. On the other hand, they may be 
overly pessimistic: although they have never experienced 
or heard about a failure occurring, they cannot exclude that 
the failure will ever occur. As detailed in a 2008 critique 
of risk matrices, 43 the quantitative value of risk analysis is 
limited by the mathematical assumptions of the embedded 
judgments of frequency and severity rating, in this context, 
the frequency and severity of barriers to optimal care for 
patients with SCD. In healthcare, risk contributors are not 
necessarily "randomly selected pairs of hazards" and in 
fact represent a number of possible outcomes, based on 
observed clinical occurrences (consequences). However, our 
intent at adapting risk analysis to improve the care of SCD 
patients is qualitative at this point in time, not quantitative, 
and represents a qualitative assessment of multiple risks 
that cause a healthcare process to fail. 44 This is a dynamic 
process, and allowed for the input of multiple providers who 
can better suggest as a whole the barriers that may be in 
place. Furthermore, this methodology includes the use of a 
safeguard or safety intervention, which could be reasonably 
expected to impact the frequency and severity of risk 
contributors. The quantitative impact of the barriers and the 
success of the safeguards can only be determined by analysis 
of data which is currently underway. 
CONCLUSION 

This study demonstrates the feasibility of conducting a com- 
plex FMECA of each aspect of four clinical processes of SCD 



ED care at two hospitals. Results from the FMECA identified 
specific process failures and have been instrumental in deter- 
mining the focus of QI activities at each site. While a FMECA 
is an excellent tool for identifying potential weaknesses or 
failures in complex processes, implementation of process and 
quality improvement techniques to address the identified fail- 
ures and vulnerabilities in the ED SCD process of care is also 
critical. Units and facilities that undertake FMECAs can use 
the results to guide QI activities to redesign, test, and improve 
specific processes of care to the benefit of both patients and 
those who care for them. 
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